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Abstract 

We propose a new LMI approach to the design of optimal switching sequences for 
polynomial dynamical systems with state constraints. We formulate the switching 
design problem as an optimal control problem which is then relaxed to a linear 
programming (LP) problem in the space of occupation measures. This infinite- 
dimensional LP can be solved numerically and approximately with a hierarchy of 
convex finite-dimensional LMIs. In contrast with most of the existing work on LMI 
methods, we have a guarantee of global optimality, in the sense that we obtain 
an asympotically converging (i.e. with vanishing conservatism) hierarchy of lower 
bounds on the achievable performance. We also explain how to construct an almost 
optimal switching sequence. 



1 Introduction 

A switched system is a particular class of a hybrid system that consists of a set of dynam- 
ical subsystems, one of which is active at any instant of time, and a policy for activating 
and deactivating the subsystems. One may encounter such dynamical systems in a wide 
variety of application domains such as automotive industry, power systems, aircraft and 
traffic control, and more generally the area of embedded systems. Switched systems have 
been the concern of many researchers and many results are available for stability anal- 
ysis and control design. They put in evidence the important fact that it is possible to 
orchestrate the subsystems through an adequate switching strategy in order to impose 
global stability. Interested readers may refer to the survey papers [TOl EOj [291 ES] and the 
interesting and useful books [211 EO] and the references therein. 

In this context, switching plays a major role for stability and performance properties. 
Indeed, switched systems are generally controlled by switched controllers and the control 
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signal is intrinsically discontinuous. As far as optimality is concerned, several results are 
also available in two main different contexts: 

• the first category of methods exploits necessary optimality conditions, in the form 
of Pontryagin's maximum principle (the so-called indirect approaches), or through 
a large nonlinear discretization of the problem (the so-called direct approaches) , see 
[aSElIISlEHlEllESlEniEZlEHlEIlfor details. Therefore only local optimality 
can be guaranteed for general nonlinear problems, even when discretization can be 
properly controlled; 

• the second category collects extensions of the performance indexes H2 and H^o orig- 
inally developped for linear time invariant systems without switching, and use the 
flexibility of Lyapunov's approach, see for instance [131 E] and references therein. 
Even for linear switched systems, the proposed results are based on nonconvex op- 
timization problems (e.g. bilinear matrix inequality conditions) difficult to solve 
directly. Sufficient linear matrix inequality (LMI) design conditions may be ob- 
tained, but at the price of introducing a conservatism (pessimism) which is hard, 
if not impossible, to evaluate. Since the computation of this optimal strategy is a 
difficult task, a suboptimal solution is of interest only when it is proved to be con- 
sistent, meaning that it imposes to the switched system a performance not worse 
than the one produced by each isolated subsystem [14j . 

Despite the interest of these existing approaches, the optimal control problem is not 
completely solved for switched systems and new strategies are more than welcome, as 
computationally viable design techniques are missing. In this paper, we consider the 
problem of designing optimal switching rules in the case of polynomial switched dynamical 
systems. Classically, we formulate the optimal control switching problem as an optimal 
control problem with controls being functions of time valued in {0, 1}, and we relax it 
into a control problem with controls being functions of time valued in [0, 1] . In contrast 
with existing approaches following this relaxation strategy, see e.g. |2l [21], relying on 
Pontryagin's maximum principle, our aim is to apply the approach of [TB], which consists 
in modeling control and trajectory functions as occupation measures. This allows for a 
convex linear programming (LP) formulation of the optimal control problem. This infinite- 
dimensional LP can be solved numerically and approximately with a hierarchy of convex 
finite-dimensional LMIs. On the one hand, our approach follows the optimal control 
modeling framework. On the other hand, it exploits the flexibility and computational 
efficiency of the convex LMI framework. In contrast with most of the existing work on 
LMI methods, we have a guarantee of global optimality, in the sense that we obtain an 
asympotically converging (i.e. with vanishing conservatism) hierarchy of lower bounds on 
the achievable performance. 

The paper is organized as follows: in Section |2] we state the optimal switching problem 
to be solved, and we propose an alternative, relaxed formulation allowing chattering of 
the trajectories. In Section |3] we introduce occupation measures as a device to linearize 
the optimal control problem into an LP problem in the cone of nonnegative measures. In 
Section |4] we explain how to solve the resulting inflnite-dimensional LP with a converging 
hierarchy of flnite-dimensional LMI problems. As explained in Section [5| an approximate 



2 



optimal switching sequence can be extracted from the solutions of the LMI problem, and 
this is illustrated with classical examples in Section [6] Finally, the paper ends with a 
sketch of further research lines. 



2 Optimal switching problem 

Consider the optimal control problem 

p* = inf l^it){t,x{t))dt 

s.t. x(t) = /^(t)(t,a;(t)), a(t) G {1,2, . . . ,m} 

x(0) G Xo, x{T) eXt ^ ^ 

xlt)eX, te[0,T] 

with given polynomial velocity field /^(i) G ]R[t, x]" and given polynomial Lagrangian 
lo-(t) £ ^[t, x] indexed by an integer-valued signal a : [0, T] — )■ {1, 2, . . . , m}. System state 
x{t) belongs to a given compact semialgebraic set X C M" for all t G [0, T] and the initial 
state x{0) resp. final state x{T) are constrained to a given compact semialgebraic set 
Xq C X resp. Xt C X. In problem ([T| the infimum is w.r.t. sequence a and terminal 
time T. 

In this paper, for the sake of simplicity, we assume that the terminal time T is finite, that 
is, we do not consider the asymptotic behavior. Typically, if a solution to problem ([T]) is 
expected for a very large or infinite terminal time, we must reformulate the problem by 
relaxing the state constraints. 

Optimal control problem ([T]) can then be equivalently written as 

p* = iniu YJk=ilkit,x{t))uk{t)dt 

s.t. dx{t) = YJ^=ifk{t,x{t))uk{t)dt 

x(0) G Xo, x{T) G Xt ^ ' 

x(t)GX, u{t)eU, tG[0,T] 

where the infimum is with respect to a time- varying vector u{t) which belongs for all 
t G [0,T] to the (nonconvex) discrete set 

f/ := {(1, 0, . . . , 0), (0, 1, . . . , 0), . . . , (0, 0, . . . , 1)} C M"^. 

In general the infimum in problem ^ is not attained (see our numerical examples later 
on) and the problem is relaxed to 

P*R = inf JoT.T=Jk{t,x{t))uk{t)dt 

s.t. dx{t) = YJk=ifk{i,x{t))uk{t)dt 

x(0) G Xo, x{T) eXr ^ ' 

xlt) G X, u{t) G conv U, t G [0, T] 

where the minimization is now with respect to a time- varying vector u{t) which belongs 
for all t G [0,T] to the (convex) simplex 

m 

conv t/ = {m G M™ : ^ Mfc = 1, Mfc > 0, /c = 1, . . . , m}. 

k=l 
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In [2], problem ^ is called the embedding of problem ([T]), and it is proved that the set of 
trajectories of problem ([T]) is dense (w.r.t. the uniform norm in the space of continuous 
functions of time) in the set of trajectories of embedded problem (|3|. Note however that 
these authors consider the more general problem of switching design in the presence of 
additional bounded controls in each individual dynamics. To cope with chattering effects 
due to the simultaneous presence of controls and (initial and terminal) state constraints, 
they have to introduce a further relaxation of the embedded control problem. In this 
paper, we do not have controls in the dynamics, and the only design parameter is the 
switching sequence. 

An equivalent way of writing the dynamics in problem (|3| is via a differential inclusion 

x{t) G conv{/i(t,x(t)),...,/„(t,x(t))}. (4) 

By this it is meant that at time t, the state velocity x{t) can be any convex combina- 
tion of the vector fields fkit,x{t)), k = 1, . . . ,m, see e.g. Section 3.1] for a tutorial 
introduction. For this reason, problem ([s]) is also sometimes called the convexification of 
problem ([T]). 

Since problem ([s]) is a relaxation of problem ([T]), it holds p*j^ < p*. For most of the 
physically relevant problems, and especially when the state constraints in problem ([T| are 
not overly stringent, it actually holds that pjj = p*. For a discussion about the cases for 
which p*pj < p*, please refer to [TB^, Appendix C] and references therein. 



3 Occupation measures 

Given an initial condition xq € Xq and an admissible control u{t), denote by x{t\xQ,u), 
t G [0,T], the corresponding admissible trajectory, an absolutely continuous function of 
time with values in X. Define the occupation measure 

X S|xo, m) := / lAxB{t-,x{t\xQ^u))dt 
Jo 

for all subsets A x B in the Borel cr-algebra of subsets of [0, T] x X, where Ia{x) is the 
indicator function of set A, equal to one if x E A, and zero otherwise. We write x{t\xo, u) 
resp. ii[dt,dx\xQ,u) to emphasize the dependence of x resp. yU on initial condition xq 
and control u, but for conciseness we also use the notation x{t) resp. fi{dt,dx). The 
occupation measure can be disintegrated into 

fi{A X B)= [ ^{B\t)uj{dt) 

J A 

where ^{dx\t) is the distribution of x G M", conditional on t, and u{dt) is the marginal 
w.r.t. time t, which models the control action as a measure on [0,T]. The conditional ^ 
is a stochastic kernel, in the sense that for all t G [0, T], ^(.|t) is a probability measure on 
X, and for every B in the Borel a-algebra of subsets of X, ^(-B|.) is a Borel measurable 
function on [0,T]. An equivalent definition is ^{B\t) = Isixit)) = 5x{t){B) where 5 is 
the Dirac measure. The occupation measure encodes the system trajectory, and the value 
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jj{dt, B) = /i([0, T] X B) is equal to the total time spent by the trajectory in set B C X. 
Note also that time integration of any smooth test function v : [0,T] x X — )■ M along a 
trajectory becomes a time and space integration against n, i.e. 

v{t,x{t))dt= / / v{t, x)fi{dt, dx) = / vfi. 

Jo J X J 

In optimal control problem (|3|, we associate an occupation measure 

fik{dt,dx) = ^k{dx\t)ujk{t) 
for each system mode = 1, . . . , m, so that globally 

m 
k=l 

is the occupation measure of a system trajectory subject to switching. The marginal Uk 
is the control, modeled as a measure which is absolutely continuous w.r.t. the Lebesgue 
measure, i.e. such that 

/ fikidt,dx) = ujk{dt) = Uk{t)dt 
Jx 

for some measurable control function Uk{t), k = l,...,m. The system dynamics in 
problem ([s]) can then be expressed as 

m 

dx{t) = Y,fk{x{t))uk{dt) (5) 

k=l 

where the controls are now measures Uk- To enforce that u{t) G conv U for almost all 
times t G [0,T], we add the constraint 

m 

Y,Mdt) = I[o,T]{t)dt (6) 

k=l 

where the right hand side is the Lebesgue measure, or uniform measure on [0, T]. 

Given a smooth test function f : [0, T] x X — M and an admissible trajectory x(t) with 
occupation measure fi{dt,dx), it holds 

dv{t, x{t)) = v{T, x{T)) - v{0, x{0)) 
= + Efcgradt;(t,a;(t))/fc(t,a;(t))^zfe(t)) dt 

= lo Ix {%it,x)ii{dt,dx)+ 



grad v{t, x)fk{t, x)iik{.dt, dx)) 

dv 

ail 



Now, consider that the initial state is not a single vector xq but a random vector whose 
distribution is ruled by a probability measure /iq, so that at time t the state x(t) is also 
modeled by a probability measure /if(.) := not necessarily equal to Sx{t)- The 

interpretation is that fit{B) is the probability that the state x{t) belongs to a set i? C 
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X. Optimal control problem ^ can then be formulated as a linear programming (LP) 
problem: 

P*M = inf Efc / ^fc/^fc s.t. 

JvfiT- J vfio = Efc / S/^fc + grad t;/fc/ifc 
J2kl^f^k = Jw 

\/v e Ci([o,r] X X), \/w e C\[o,T]) 

where the infimum is w.r.t. measures /io G ^+(-^0)5 f^T G M+{Xt), fJ^k £ ^+([0,7"] x X), 
k = 1, . . . ,m with M+(yl) denoting the cone of finite nonnegative measures supported on 
A, identified as the dual of the cone of nonnegative continuous functions supported on A. 

It follows readily that p* > p*ji > p*M, and under some additional assumptions it should 
be possible to prove that p*j^ = p*^ and that the marginal densities Uk extracted from 
solutions /ifc of problem ([T]) are optimal for problem (|2| and hence problem ([T]). We leave 
the rigorous statement and its proof for an extended version of this paper. 

Note that the use of relaxations and LP formulations of optimal control problems (on 
ordinary differential equations and partial differential equations) is classical, and can be 
traced back to the work by L. C. Young, Filippov, and then Warga and Gamkrelidze, 
amongst many others. For more details and a historical survey, see e.g. [12l Part III]. 



4 Solving the LP on measures 

To summarize, we have formulated our relaxed optimal switching control problem (|3| 
as the convex LP ([T]) in the space of measures. This can be seen as an extension of 
the approach of [TH] which was originally designed for classical optimal control problems. 
Alternatively, this can also be understood as an application of the approach of [7] where the 
control measures are restricted to be absolutely continuous w.r.t. time. Indeed, absolute 
continuity of the control measures is enforced by relation (|6]). The infinite-dimensional LP 
on measures ([T]) can be solved approximately by a hierarchy of finite-dimensional linear 
matrix inequality (LMI) problems, see [IHl El [IS] for details (not reproduced here). The 
main idea behind the hierarchy is to manipulate each measure via its moments truncated 
to degree 2d, where ci is a relaxation order, and to use necessary LMI conditions for a 
vector to contain moments of a measure. The hierarchy then consists of LMI problems of 
increasing sizes, and it provides a sequence of lower bounds < p* which is monotonically 
increasing, i.e. p*^ < p*^^^ and asymptotically converging, i.e. limd^oo P*d = P* ■ 

The number of variables at the LMI relaxation of order d grows linearly in m (the 
number of modes), and polynomially in d, but the exponent is a linear function of n (the 
number of states). In practice, given the current state-of-the-art in general-purpose LMI 
solvers and personal computers, we can expect an LMI problem to be solved in a matter 
of a few minutes provided the problem is reasonably well-conditioned and Nd < 5000. 
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5 Optimal switching sequence 



Let 

rT 



yk,a-= / / t'^lJ^k{dt,dx) = / f^ijJkidt), a = 0,1,... 
Jo Jx Jo 

denote the moments of measure Uk, k = 1, . . . , m + 1. Solving the LMI relaxation of order 

d yields real numbers {|/^,^}a=o,i,...,2d which are approximations to yk,a- 

In particular, the zero order moment of each measure Hk is an approximation of its mass, 
and hence of the time tk = J fJ'k ^ [0, T] spent by an optimal switching sequence on mode 

k. At each LMI relaxation d, it holds Yl^=i utfi ~ ^ ^"^^ li^id^oo Z/fc,o ~ so 

that in practice, it is expected that good approximations of tk are obtained at relatively 
small relaxation orders. 

The (approximate) higher order moments a}a=i,...,2d allow to recover (approximately) 
the densities Uk{t) of each measure Uk{dt), for /c = 1, . . . , m+1. The problem of recovering 

a density from its moments is a well-studied inverse problem of numerical analysis. Since 
we expect in many cases the density to be piecewise constant, with possible discontinuities 
here corresponding to commutations between system modes, we propose the following 
strategy. 

Let us assume that we have the moments 

Va := / f'uidt) 
Jo 

of a (nonnegative) measure with piecewise constant density 

N 

uj{dt) = u{t)dt := J2^klh-utk]it)dt 



k=l 



such that the boundary values are zero, i.e. Uq — and u^+i — 0. The Radon-Nikodym 
derivative of this measure reads 



N 

u'{dt) = ^(wfc+i - Uk)6t^{dt) 
k=i 

where St,, denotes the Dirac measure at t = tk- Let 

y;- / ru'idt) = J2i^k+i-Uk)tt 
k=i 

denote the moments of the (signed) derivative measure. By integration by parts it holds 

= -aya-i, a = 0,1,2,... 

which shows that the moments of u' can be obtained readily from the moments of u. Since 
u' is a sum of N Dirac measures, the moment matrix of u' is a (signed) sum of N rank-one 
moment matrices, and the atoms tk as well as the weights Uk+i — Uk, k — 1, . . . , N can 



7 



be obtained readily from an eigenvalue decomposition of the moment matrix as explained 
e.g. in [IHl Section 4.3]. 

More generally, the reader interested in numerical methods for reconstructing a measure 
from the knowledge of its moments is referred to [T7] and references therein, as well as 
to the recent works [HI [H E] which deal with the problem of reconstructing a piecewise- 
smooth function from its Fourier coefficients. To make the connection between moments 
and Fourier coefficients, let us just mention that the moments i/a = J t°'u{t)dt of a smooth 
density u{t) are (up to scaling) the Taylor coefficients of the Fourier transform u{s) : = 
J Q-'^'^i-^^ii^t^dt = l/ag"- If the Ua are given, then u{s) is given by its Taylor series, 

and the density u{t) is recovered with the inverse Fourier transform u{t) = J e^'^^'^^u{s)ds. 
Numerically, an approximate density can be obtained by applying the inverse fast Fourier 
transform to the (suitably scaled) sequence {ya}a=QX---M of moments. 



6 Examples 
6.1 First example 

Consider the scalar (n = 1) optimal control problem ([T]): 

p* = inf x'^{t)dt 

s.t. x{t) = aa{t)x{t) 

x{0) = l x(l)Ghl,l] 

x(t)e[-i,i], VtG [0,1] 

where the infimum is w.r.t. to a switching sequence a : [0, 1] {1, 2} and 

ai := —1, a2 '■= 1. 

In Table [l] we report the lower bounds p*^ on the optimal value p* obtained by solving LMI 
relaxations of increasing orders d, rounded to 5 significant digits. We also indicate the 
number of variables (i.e. total number of moments) of each LMI problem, as well as the 
zeroth order moment of each occupation measure (recall that these are approximations of 
the time spent on each mode). We observe that the values of the lower bounds and the 
masses stabilize quickly. 

In this simple case, it is easy to obtain analytically the optimal switching sequence: 
it consists of driving the state from x(0) = ^ to x(^) = with the first mode, i.e. 
Ui(t) = 1, U2(t) = for t G [0, |[, and then chattering between the first and second mode 
with equal proportion so as to keep x(t) = 0, i.e. ui{t) = ^,U2(t) = | for t g]|,1]. It 
follows that the infimum is equal to 

"'^l (2-*) ^'-T4 

Because of chattering, the infimum in problem ([T]) is not attained by an admissible switch- 
ing sequence. It is however attained in the convexified problem ([s]). 
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d 


P*d 


Nd 






1 


-5.9672 


.10-9 


18 


0.74056 


0.25944 


2 


4.1001 ■ 


10-2 


45 


0.75170 


0.24830 


3 


4.1649 ■ 


10-2 


84 


0.74632 


0.25368 


4 


4.1666 • 


10-2 


135 


0.74918 


0.25082 


5 


4.1667- 


10-2 


198 


0.74974 


0.25026 


6 


4.1667- 


10-2 


273 


0.74990 


0.25010 


7 


4.1667- 


10-2 


360 


0.74996 


0.25004 



Table 1: Lower bounds on the optimal value p* obtained by solving LMI relaxations 
of increasing orders d; is the number of variables in the LMI problem; y^^ is the 
approximate time spent on each mode k = 1,2. 

The optimal moments can be obtained analytically 

^^- = 2/ '^'= 4T^ 

and they can be compared with the following moment vectors obtained numerically at 
the 7th LMI relaxation: 

yl = [0.74996 0.31246 0.18746 0.13277 0.10308---], 

= [0.75000 0.31250 0.18750 0.13281 0.10313---], 

yl = [0.25004 0.18754 0.14588 0.11723 0.096919---], 

y2 = [0.25000 0.18750 0.14583 0.11719 0.096875---]. 

We observe that the approximate moments yl closely match the optimal moments yk, so 
that the approximate control law Uk extracted from yl will be almost optimal. 



6.2 Second example 

We revisit the double integrator example with state constraint studied in 
as the following optimal switching problem: 



formulated 



-- inf T 

s.t. x{t) = f^(t)ix{t)) 

x{0) = [l,l], a;(T) = [0,0] 
X2{t)>-1, VtG[0,T] 

where the infimum is w.r.t. to a switching sequence a : [0, T] 1— t- {1, 2} with free terminal 
time T > and affine dynamics 



/i 



X2 



/2 



X2 
1 
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We know from ^18j that the optimal sequence consists of starting with mode 1, i.e. ui{t) = 
1, U2it) = for t e [0,2], then chattering with equal proportion between mode 1 and 2, 
i.e. Ui{t) = U2{t) = ^ for t G [2, |] and then eventually driving the state to the origin 
with mode 2, i.e. Uiit) = 0, U2it) = 1 for t G [|, |]. Here too the infimum p* = ^ is not 
attained for problem Q, whereas it is attained with the above controls for problem 

In Table [T] we report the lower bounds p*^ on the optimal value p* obtained by solving LMI 
relaxations of increasing orders d, rounded to 5 significant digits. We also indicate the 
number of variables (i.e. total number of moments) of each LMI problem, as well as the 
zeroth order moment of each occupation measure (recall that these are approximations of 
the time spent on each mode). We observe that the values of the lower bounds and the 
masses stabilize quickly to the optimal values = |, ?/i,o = |, 1/2,0 = |- 



d 


P*d 




yU 


1/2,0 


1 


2.5000 


30 


1.7500 


0.75000 


2 


3.2015 


105 


2.1008 


1.1008 


3 


3.4876 


252 


2.2438 


1.2438 


4 


3.4967 


495 


2.2484 


1.2484 


5 


3.4988 


858 


2.2494 


1.2494 


6 


3.4993 


1365 


2.2496 


1.2497 


7 


3.4996 


2040 


2.2498 


1.2498 



Table 2: Lower bounds p'^ on the optimal value p* obtained by solving LMI relaxations 
of increasing orders d; Nii is the number of variables in the LMI problem; ?/^q is the 
approximate time spent on each mode k = 1,2. 

The optimal switching sequence, which corresponds here to control measures uJk{dt) with 
piecewise constant densities, is obtained numerically as explained in Section [5| by consid- 
ering the moments of the (weak) derivative of control measures. 



6.3 Third example 

Consider the optimal control problem ([T]): 



Idt 



p* = inf Jg°° ||a;( 

s.t. x(t) = A„(^t)x(t) 
x{0) = [0, -1] 

where the infimum is w.r.t. to a switching sequence a : [0, 00) 1— )■ {1, 2} and 



-1 
1 



A. 



1 



-2 
-1 



Since our framework cannot directly accomodate infinite-horizon problems, we introduce 
a terminal condition ||a;(T)||2 < 10~^ so that terminal time T is finite. It means that the 
switching sequence should drive the state in a small ball around the origin. 

In Table [3] we report the lower bounds p*^ on the optimal value p* obtained by solving LMI 
relaxations of increasing orders d, rounded to 5 significant digits. We also indicate the 
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d 


Pd 


Nd 


2/1,0 




1 


0.24294 


30 


1.4252 


1.4489 


2 


0.24340 


105 


2.0639 


1.9237 


3 


0.24347 


252 


1.9639 


1.8922 


4 


0.24347 


495 


1.9537 


1.8904 


5 


0.24347 


858 


1.9572 


1.8872 


6 


0.24347 


1365 


1.9677 


1.8940 


7 


0.24347 


2040 


1.9669 


1.8928 



Table 3: Lower bounds on the optimal value p* obtained by solving LMI relaxations 
of increasing orders d; is the number of variables in the LMI problem; y^^ is the 
approximate time spent on each mode k = 1,2. 

number of variables (i.e. total number of moments) of each LMI problem, as well as the 
zeroth order moment of each occupation measure (recall that these are approximations of 
the time spent on each mode). We observe that the values of the lower bounds stabilize 
quickly. 



- 



-0.2 



-OA 



-0.6 



-0.8 



Target 



Chattering 



Source 



Mode 1 



-0.12 



-0.1 



-0.08 



-0.06 

X, 



-0.04 



-0.02 



Figure 1: Suboptimal trajectory starting at source point x = (—1,0) with mode 1, then 
chattering between modes 1 and 2 to reach the target, a neighborhood of the origin. 

In Figure [T] we plot an almost optimal trajectory inferred from the moments of the occu- 
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pation measure, for an LMI relaxation of order d = 8. The trajectory consists in starting 
from X = (—1, 0) with mode 1 during 0.065 time units, and then chattering between mode 
1 and mode 2 with respective proportions 49.3/50.7 until x reaches the neighborhood of 
the origin ||a;(T)||2 < 10~^ for T = 3.84. This trajectory is slightly suboptimal, as it yields 
a cost of 0.24351, slightly bigger than the guaranteed lower bound of 0.24347 on the best 
achievable cost obtained by the LMI relxation. It follows that this trajectory is very close 
to optimality. For comparison with available suboptimal solutions, using |13l Theorem 1], 
the so-called min switching strategy yields with piecewise quadratic Lyapunov functions 
a suboptimal trajectory with a cost of 0.24948. 

7 Conclusion 

In this paper we address the problem of designing an optimal switching sequence for a 
hybrid system with polynomial Lagrangian (objective function) and polynomial vector 
fields (dynamics). With the help of occupation measures, we relax the problem from 
(control) functions with values in {0, 1} to (control) measures which are absolutely con- 
tinuous w.r.t. time and summing up to one. This allows for a convex linear programming 
(LP) formulation of the optimal control problem that can be solved numerically which a 
classical hierarchy of finite-dimensional convex linear matrix inequality (LMI) relaxations. 

We can think of two simple extensions of our approach: 

• Open-loop versus closed-loop. In problem ([T| the control signal is the switching 
sequence a{t) which is a function of time: this is an open-loop control, similarly to 
what was proposed in [7] for impulsive control design. In addition, constrain the 
switching sequence to be an explicit or implicit function of the state, i.e. a{x(t)), a 
closed-loop control signal. In this case, each occupation measure will be explicitly 
depending on time, state and control, and it will disintegrate as fi{dt, dx, du) = 
^{dt I t,u)u{du I t)dt, and we should follow the framework described originally in 

m- 

• Switching and impulsive control. We may also combine switching control and im- 
pulsive control if we extend the system dynamics ^ to 

m p 
dx{t) = fk{x{t))Uk{dt) + Y^g^{t)T,{dt) 
k=l j=l 

where gj are given continuous vector functions of time and tj are signed measures 
to be found, jointly with the switching measures Uk- Whereas switching control 
measures cok are restricted by ^ to be absolutely continuous w.r.t. the Lebesgue 
measure of time, impulsive control measure Tj can concentrate in time. For example, 
for a dynamical system dx{t) = g{t)T{dt), a Dirac measure T{dt) = 6s enforces at 
time t = s a state jump x~^{s) = x^ (s) + g{s). In this case, to avoid trivial solutions, 
the objective function should penalize the total variation of the impulsive control 
measures, see [7|. 
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• Removing the states in the occupation measures. In the case that all dynamics 
fk{t, x), k = 1, . . . ,171 are affine in x, we can numerically integrate the state trajec- 
tory and approximate the arcs by polynomials of time. It follows that the occupation 
measures fik{dt, dx), once integrated, do not depend on x anymore. They depend on 
time t only. We can then use finite-dimensional LMI conditions which are necessary 
and sufficient for a vector to contain the moments of a univariate measure, there 
is no need to construct a hierarchy of LMI relaxations. There is however still a 
hierarchy of LMI problems to be solved, now indexed by the degree of the polyno- 
mial approximation of the arcs of the state trajectory. To cope with high degree 
univariate polynomials, alternative bases than monomials are recommended (e.g. 
Chebyshev polynomials), see [8] for more details. 
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